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We explicitly construct a non-microreversible transition matrix for a Markov process and apply 
it to the standard three-state Potts model. This provides a clear and simple demonstration that 
the usual micoreversibility property of thermodynamical Monte Carlo algorithms is not strictly 
necessary from a mathemetical point of view. 
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r—s I The practice of statistical physics often involves Monte Carlo studies of model thermodynamic systems such as the 

pg Ising spin-lattice [i|, 0, y] and the Potts model [J, Q . These studies are normally conducted with a Markov process 

that takes a random walk through the space of all allowed system configurations, producing a chain of states in which 
each individual state appears with a frequency proportional to its Gibbs probability p . Such a Markov process must 
satisfy two conditions. The first of these is the accessibility criterion, that from any given initial state it must be 
t , possible to evolve the system, given sufficient time, into any other possible state. This is equivalent to the physical 
property of ergodicity. The second requirement, in order for the equilibrium Gibbs ensemble to exist, is that the 
state-to-state transition probabilities of the Markov process must satisfy the invariance condition 

O; Vi, TT, ^^TTjPj,. (1) 

D I all j 

It is much more common, however, to see algorithms for modeling physical systems that are based upon the stronger 

. condition of microreversibility (or detailed balance) 

C^ ■ 

C/2 ! T^iPij = '^]Pji Vi,j. (2) 

Such algorithms include those of Metropolis et al. [7] , Barker [9| , and Hastings [y] . Some texts will even state that 
equation ^ is a requirement for any Markov process in which the frequency of occurrence of a given state in the 
chain is proportional to its Gibbs probability [l3]- Hastings has noted that this is not the case ^ and Handscomb 
'^ ' has constructed a non-microreversible Markov process for sub-systems of three states of equal Gibbs probability [lH . 
^ ' Here we shall construct a non-microreversible Markov process for a general three-state system and apply it to the 
O ■ standard Potts model. Note that for a system of only two states, such as the Ising model, the microreversibility and 
invariance conditions are equivalent. 

A Markov process can be written in matrix form 
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> ■ TT = Mtt (3) 

("^ I where tt is the vector of Gibbs probabilities tt^ for all possible states i, and the transition matrix M has the set of all 

f — . state-to-state transition probabilities ptj for its elements. Observe that this expression is equivalent to the invariance 

04 condition, equation ([T]), and so this equation must hold true if a thermodynamical equilibrium ensemble is to exist. 

r — I , Because we must observe something when sampling the system, we require both 
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TT, e [0, 1] Vi (4) 

and completeness; 

^7r, = l. (5) 



all i 
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C^ Since something well defined must take place at each step of the Markov process, we also require 



P,, e[0,l] Vz,j (6) 

and that the outgoing transition probabilities for each state must sum to unity; 



^p., =1 V*. (7) 

all J 



Now, consider the Markov process transition matrix for a three state system 



Paa Pba Pc 

Pah Phh Pch I . (8) 

Pac Phc Pc 



Without loss of generality, we order the states such that TTa < TTb < tTc- This leaves us free to choose Pac = (1 ^ «)■ 
where a € [0, 1]. We then have constrained choice of Pab = Oi{l — f3), where /3 € [0, 1]. Equation ([7]) implies paa = ct/3. 
We can choose Pca = (1 — ctP)'^{TTa/TTc), where 7 G [0, 1]. Invariance requires that pba = (1 ^ a/5)(l — 7)(7ra/7rb). A 
fourth free choice is pbc = 0, from which it follows, by equations (P) and (O, that pbb = 1 — 9— (1 — a/?)(l — 7)(7ra/7rb), 
Pcb = (1 — a — (1 — Q;/3)7)(7ra/7rc) + 9{'k\,/tTc), and Pcc = 1 — (1 — a)(7ra/7rc) — 9{'k\,/tTc). The constraint of equation 



requires 



so that writing 



0,min<^ — i ^-^,1- (1 -a/3)(l-7) — 

TTb TTb 



(9) 



^ = 5min(^^^^^^,l-(l-a/3)(l-7)^l (10) 

L TTb TTb J 

yields a matrix M with four independent free parameters a, /?, 7 and 6 all chosen from the interval [0, 1]. The right hand 
term in the brackets of equation (fTO| is guaranteed to be the lesser of the two if ttc > 1/2, or if a — 7 > a/3(l — 7). 
Otherwise the upper bound of 9 will have to be determined on a case-by-case basis. This results in a somewhat 
unsatisfactory algebraic expression for M, that can be avoided through a restriction to ^ = 0. This yields a transition 
matrix with three independent parameters and no complications; 

7(1 - a/?) ^ \ 

(11) 

Further choosing a = 1 and 7 = reduces this to a two state system. Taking (3 = gives the Metropolis algorithm 
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setting P = 7ra/(7ra + vTb), gives Barker's algorithm @] 

[::]-(^ ^) [;;;), (13) 



and (3 = 1 — 57rb/(7ra -I- TTb), with ^ e [0, (vTa + 7rb)/7rb], gives Hasting's algorithm [31 

UbJ -Iv C;;:^ ^-^i^J Ub J ' ^^'^ 

This, of course, reduces to Barker's algorithm if ^ = 1, and to the Metropolis algorithm if ^ = {iia + 7rb)/7rb. 

Returning to the transition matrix of equation (jlip . we see that, in general, microreversibility is violated since, for 
instance, TTaPac is not identically equal to TTcPca, regardless of the choice of 5. However, it is easy to verify that the 
columns sum to unity, that all matrix elements lie within [0, 1], and that the invariance condition of equation ([1]) is 
satisfied. Hence this provides a legitimate Monte Carlo method that converges to an equilibrium ensemble distribution. 
Figure [T] shows the application of this method to the three-state Potts model. This is sufficient to demonstrate the 
viability and practicality of Markov processes that do not have the microreversibility property. It would of course be 
interesting to search the parameter space for an optimal choice to minimise thermalisation, correlation and mixing 
times I12i] , however this search space is large and the differences are likely to be subtle around local minima. 
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FIG. 1: Approach of a three-state Potts model to thermal equilibrium at T < Tc by Barker's algorithm (dotted line) and by 
the non-microreversible process of equation (lll|l with a = 0.1, (3 = 0.8, and 7 = 0.2 (solid line). 
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